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Abstract — We study computation of a modulo-sum of two 
binary source sequences over a two-user erasure multiple access 
channel. The channel is modeled as a binary-input, erasure 
multiple access channel, which can be in one of three states 
- either the channel output is a modulo-sum of the two input 
symbols, or the channel output equals the input symbol on the 
first link and an erasure on the second link, or vice versa. 
The associated state sequence is independent and identically 
distributed. We develop a new upper bound on the sum-rate 
by revealing only part of the state sequence to the transmitters. 
Our coding scheme is based on the compute and forward and the 
decode and forward techniques. When a (strictly) causal feedback 
of the channel state is available to the encoders, we show that 
the modulo-sum capacity is increased. Extensions to the case of 
lossy reconstruction of the modulo-sum and to channels involving 
additional states are also treated briefly. 

Index Terms — Network Information Theory, Modulo-Sum 
Computation, Multiple Access Channels, Erasure Channels, 
Compute and Forward. 

I. Introduction 

In many emerging applications in networked systems, it is 
sufficient for intermediate nodes to compute a function of the 
source messages. For example in a two-way relay channel, 
the two users need to mutually exchange messages using 
a central relay node. It is natural that the relay node only 
computes a modulo-sum of the messages. In other applica- 
tions, the destination node may only be interested in some 
pre-determined function of the observations made by remote 
terminals. For example, in a temperature monitoring system, 
the fusion centre may only be interested in computing an 
average of the observations made by each of the sensor nodes. 

Korner and Marton |1| introduce a multi-terminal source 
coding problem where the destination terminal is required to 
compute a modulo-sum of two binary sources. Each source 
is revealed to one encoder and the source sequences need 
to be compressed such that the destination can recover the 
modulo-two sum of the two binary source sequences. The 
authors establish the optimality of a scheme that uses identical 
linear codebooks for compressing the two source sequences. 
There has been a significant interest in both source and channel 
coding techniques for in-network function computation in 
recent times; see e.g., l2l- |[T6l . 
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We study the computation of a modulo-sum of two messages 
over a multiple access channel, introduced in J6), Q. These 
works consider the Gaussian multiple access channel (MAC) 
and observe that for a wide range of signal-to-noise ratio 
(SNR), one can achieve higher rates using lattice codes instead 
of an i.i.d. random code ensemble. Because of its additive na- 
ture, the Gaussian MAC channel is well suited for computing 
the modulo sum of two messages using lattice codes. A simple 
upper bound, obtained by revealing one of the messages to the 
destination, suffices to establish the near-optimality of lattice- 
based schemes for a wide range of channel parameters. Similar 
schemes can also be developed for computation of a modulo- 
sum over the binary multiple-access channel. 

In the present paper we study a MAC channel model that 
does not appear naturally matched for computing the modulo- 
sum function. Our model is an erasure multiple access channel 
with binary inputs. With a certain probability, the destination 
observes a modulo-sum of the two transmitted bits whereas 
with a certain probability the destination observes only one 
of the two bits and an erasure symbol associated with the 
other transmitted bit. We establish upper and lower bounds 
on the modulo sum capacity of such a channel model. The 
upper bound is tighter than the simple upper bound obtained 
by revealing one of the messages to the destination. The 
lower bound is based on compute-and-forward and decode- 
and-forward schemes used in earlier works. It can be achieved 
by using identical linear codebooks at the two senders. We also 
briefly consider the case when there is strictly causal feedback 
of the state sequence available from the destination (using e.g., 
ARQ) and show that the capacity can be increased compared 
to the case without such feedback. 

Erasure channel models are suitable when one considers 
error-control coding in the upper layers of the protocol stack. A 
system could be designed such that when both the transmitting 
nodes are active, the physical layer computes the modulo sum 
of the information bits and passes it to the upper layer. Due 
to back-off mechanisms a transmitting node may not be active 
in each slot. This leads to erasures on the respective links as 
considered in this paper. 



II. Problem Statement 

We study a multiple access channel with two transmitters 
and one receiver. The channel input symbols are denoted by x 
and y respectively and are binary valued. The channel output is 
denoted by z and is also binary valued. The channel transition 
probability is controlled by a state variable s S {0,1,2}. In 
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particular we have: 




(1) 



We assume that the receiver is revealed the pair (z, s). We 
assume that Pr(s = 1) = Pr(s = 2) = e and Pr(s = 0) = 1 — 
2er where e satisfies < e < 1/2. The channel is memoryless 
i.e., Pr(s" = s n ) = nti Pr(s t = s t ). 

A code of length n is defined as follows. Sender i observes a 
message Wj uniformly and independently distributed over the 
set [1, . . . , 2 nR }. For sake of convenience we will represent 
message Wi as a sequence b™ R consisting of nR indepen- 
dent and equiprobable bits. We define u = W\ © 1/1/2 as the 
exclusive-or of b" R © b 2 lR - 

The messages are mapped into codewords x" = f n (wi) 
and y" = .g n (w2) respectively and the decoder is required to 
produce u = h n (z n ,s n ). An error is declared if {u ^ u}. 

A rate R is achievable if there is a sequence of encoders 
and decoders such that the error probability goes to zero as n 
approaches infinity. The largest achievable rate is defined as 
the modulo-sum capacity. 

III. Main Results 
We state the main results in this section. 

A. Lower Bound 

We propose the following lower bound on the modulo-sum 
capacity. 

Proposition 1. The modulo-sum capacity is lower bounded by 
the following expression: 

1 



C>R~ = max <M - 2e, 



(2) 



The lower bound of R = 1 — 2s is attained using a 
compute-and-forward technique [7| where identical linear 
codebooks are used by the two transmitters. The lower bound 
R = 1/2 can be attained in several ways. Perhaps the 
simplest way is to transmit w\ and 1/1/2 to the destination us- 
ing independent multiple-access channel codebooks 0171 . We 
call this scheme decode-and-forward. Interestingly if we use 
identical codebooks at the two transmitters ifTTI for decode- 
and-forward, the rate R = min(l/2, 2e) is achieved. As we 
will show, a variant of the compute-and-forward scheme also 
achieves R = 1/4, when s > 1/4. 

B. Upper Bound 

We provide the following upper bound on the modulo-sum 
capacity. 

Theorem 1. The modulo-sum capacity is upper bounded by 
the following expression: 
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Fig. 1. Main Steps in the Upper Bound (for e = 1/3). The uppermost 
figure illustrates the erasure MAC model. Each square corresponds to one 
channel use. The black squares correspond to Si = 0, i.e., z; = x; © yi, the 
shaded grey squares correspond to Si = 1, i.e., Zi = Xi and the white squares 
correspond to Si = 2 i.e., Zi = yi. Our upper bound reveals the location of 
Si = 2 to both the transmitters non-causally. Since the transmitters are not 
aware of the location of the grey and black squares, any code for this genie- 
aided channel must also be decodable when the black and grey squares are 
interchanged. This compound setup results in a tighter upper bound than the 
usual cut-set bound. 



The proposed upper bound is tighter than a genie-aided 
bound where one of the messages, say W\, is revealed to 
the decoder. We provide the key-steps in the upper bound 
derivation below. 

1 ) Revealing Side Information to the Transmitters: Our key 
step is to reveal part of the state sequence to the encoders. In 
particular define the sets A = {i : S; = 1}, B = {i : S; = 2} 
and C = {i : Si = 0}. We illustrate the technique when \A\ = 
\B\ = \C\ = ^, which roughly corresponds to the case when 
e = 1/3. We will use the notation z£ to denote the projection 
of z n onto the indices i 6 C etc. 

In our upper bound, we first reveal the knowledge of B 
to the two encoders non-causally. However the encoders are 
not aware of the sets A and C. Note from ([TJ that = Yg, 
z'X = x\ and z™ = x£ © y£. 

2) Independence of Input Signals from W\ © 1/1/2: Observe 
that is sub-sequence transmitted by user 2 and hence 
independent of u = W\ © n/2. Using this property we have: 

nR = H(u) (4) 

= H(u\y%) (5) 

= H(u]y8,x%zg) + I(x%2g ] u\y2) (6) 

< n(l - e) - H(x%,zg\yg, u)+n- o n (l), (7) 

where we use Fano's inequality in ^H(u\x^, yg, z^) < o n (l) 
and o„(l) denotes a vanishing function in n. 

3) Compound MAC Channel: Observe that the same coding 
scheme must also work when the positions of sets A and C 
are interchanged. This results in 



where (-) + equals zero if the argument inside is negative. 



nR<n(l^e)-H(x^zX\yS,u) 



o„(l). 



(8) 



3 



Combining (0 and ([8]l and ignoring the o n (l) term, we 
obtain the following: 



nR < n(l - e) - max H{x^\y^ u), H(x2,z%\y%, u) 



< n(l -e)--[ H[x% z c "|yg, u)+H(^,^\yS, u) 



(9) 

(10) 
(11) 
(12) 

(13) 
(14) 



<n(l-e)--H(x%z2,xZ,zZ\y3,u) 

= n{l-e)-±H(x%yg,xg,yZ\y2,u) 

<n(\-e)- l -H{y%y^ lU ) 

<n{l-e)-\H(y% y 2\y%) 

where (fl4] i follows from the fact that the transmit sequence 
by user 2, y n is independent of Wi and hence i/i/i © 1/1/2. 
Eq. ( TPfl i suggests that for the rate to be high (yl,yc) an d 
yg must be strongly correlated. However as we show below, 
such a constraint can only reduce the upper bound obtained 
by revealing one of the messages to the destination. 

4) Penalty from Repetition Coding: Suppose that the se- 
quence x" is completely revealed to the destination. The 
receiver only needs to compute w 2 and hence we have: 



nR < H(y n ) = HM,yS\y2) + H(yg) 



(15) 



Eliminating the joint entropy term between (fl4t and (fT5T l we 

get 



l n R< l -H{y^) + n(l-e) 



(16) 



By using the simple upper bound H(y^) < \B\ =newe get 
R < which agrees with (O for e = 1/3. 



C. Causal State Feedback 

Consider the case when the encoders are revealed the state 
sequences in a strictly causal manner. The encoding functions 
at time i can depend on the state sequence up to time i — 1 
i.e. Xi = /i(wi,sj _1 ) and y l = g l (w 2 ,s{~ 1 ). 

Proposition 2. The modulo-sum capacity the multiple access 
channel with strictly causal state feedback is lower and upper 
bounded by R^ B < C < Rp B , where 



R 



1 



FB 



l + 2e 



Rfb = 1 — e 



(17) 
(18) 



The lower bound is achieved by a two-phase protocol where 
the users transmit uncoded bits in the first phase and use a 
multiple-access code in the second phase. The upper bound is 
the genie-aided bound where one of the messages is revealed 
to the destination. The problem reduces to communicating the 
other message, say w 2 to the destination. Feedback in such a 
case is well known to not increase the point-to-point capacity. 



D. Numerical Comparisons 

Fig. |2] provides a numerical computation of the upper and 
lower bounds for the Erasure MAC channel both with and 
without feedback. The upper-most dotted curve corresponds 
to i?p B = 1 — e and is the upper bound on the capacity 
with feedback. The lowermost curve, marked with backward 
arrows, is the lower bound achieved by either the decode and 
forward or the compute and forward schemes. The other solid 
curve is our new upper bound on the capacity without feedback 
(c.f. Theorem [TJi. The fourth curve is the lower bound with 
feedback in Prop. |2] Interestingly we see that it lies above 
the upper bound for certain values of e, thus establishing that 
feedback helps in computation over the erasure multiple access 
channel. 

E. Lossy Reconstruction 

While the focus of this paper is on lossless recovery, our 
ideas can be also extended to lossy recovery. We illustrate this 
with one example. As before we consider the case when the 
two transmitters observe i.i.d. equiprobable binary sequences 
b\ and b\ respectively. The receiver is interested in the 
modulo-sum u k = b\ © b\. However it suffices to output 
any sequence u k 



that satisfies the distortion constraint 



E 



1 k 

2—1 



< D 



(19) 



where p(-, ■) is the associated distortion measure. In this paper 
we select the erasure distortion measure i.e., 



p(u, u) 




(20) 



We assume a bandwidth expansion factor of (3. Thus the 
number of channel uses is n = k/3 and the transmitters 
generate x" = fk{b k ) for i = 1,2 and the receiver outputs 
u k = gk(z n ,s n ). A distortion D is achievable if there exist a 
sequence of encoding and decoding functions that satisfy (fr9l 
as k — >• oo. We develop bounds on the achievable distortion. 

Theorem 2. An achievable distortion for modulo-sum recon- 
struction of equiprobable and independent binary sources over 
the erasure multiple access channel satisfies D outC i- < D < 
D inner where 



Dinner 
D utcr 



(l-(3R-)+ 
(l-f3R + ) + 



(21) 
(22) 



where R~ and R + are the lower and upper bounds on the 
modulo-sum capacity stated in (O and <£3j respectively and the 
function (v) + equals zero if v < and equals v otherwise. 

In particular, examining the expression for Dinner it can be 
shown that uncoded transmission is sub-optimal even when 
(3 = 1 i.e., there is no bandwidth mis-match. If the two 
users select x™ = s" for i = 1, 2 then the destination must 
declare an erasure whenever s, ^ 0. It is easy to see that the 
average distortion for this technique equals 2e. In contrast the 
expression (l2TT i equals min(2£, h) when [3 = 1. This is a strict 
improvement for e G (j, |). 
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Fig. 2. Comparison of upper and lower bounds for the Erasure-MAC channel with and without feedback. 



F. Extended Multiple Access Channel 

We consider an extension of the model in (Q3 where when 
there are two additional states — either the decoder observes 
both (x,y) or it observes an erasure. In particular we have 
that, s G {0, 1, 2, 3, 4}, where 





By, 
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= 0, 


x, 
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= 1, 


y, 




s 


= 2, 


(x 


y), 


s 


= 3, 


<*> 




s 


= 4. 



Our upper and lower bounds can be naturally extended to 
the extended multiple access channel d23l ). For simplicity we 
only focus on the lossless case. Let Pr(s = 1) = Pr(s = 
2) = 6 ■ e, Pr(s = 0) = 5(1 - 2e), Pr(s = 3) = 7 and 
Pr(s = 4) = 1 - 7 - 5. 

Proposition 3. The modulo-sum capacity of the extended 
multiple access channel in ( 1231 ) satisfies Rr < C < R + , 
where: 

R~ =7 + £ -niaxQ,(l-2e)^ (24) 

« + . 7 + J (^£±^fll) (25 » 

We observe that the lower and upper bounds for the 
extended model reduce to the corresponding bounds for the 
simplified model when 7 = and 5=1. 

IV. Lower Bound: Proof of Prop. [2 

We separately establish the achievability of R = 1 — 2e and 
R = l/2. 



A. Compute and Forward Scheme 

We use identical linear codebooks at the two transmitters 
in the compute and forward scheme to achieve R = 1 — 2e. 
Recall that the messages wi and W2 are assumed to be binary 
valued sequences of length nR bits i.e., we take 

bf = [fcn,..., 6«r] (26) 

where K = nR, denote the number of information bits in the 
message. Let G be a matrix of dimensions K x n, and let each 
entry in G be sampled independently from an equiprobable 
Bernoulli distribution. It is useful to express 

G = [gi,...,g„] (27) 

where each g; e {0, 1} K is a length K binary valued 
column vector. The transmitted sequence x T = \x\, . . . ,Xk] 
at receiver 1 is expressed as: 

x T = ■ G (28) 
= [bfgi,...,bfg„] (29) 

The transmitted sequence y T at user 2 is defined in a similar 
manner. 

The receiver is interested in computing 

u T = bj © hi = [bu © b 21 , ...Mk® b 2K ] ■ (30) 

Given our specific encoder, the received symbol can be ex- 
pressed as: 

f(bfffibj) gl , Si = 0, 
Zi = I bfg l5 s, = 1, (31) 

[b^g,, s, = 2. 

Our proposed decoder only uses the output of the channel 
when Si = and declares erasures if Si ^ 0. Let Go = G| Si=u 
be collection of column vectors in G when Si = 0. We use 
the following lemma regarding Gn: 
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Lemma 1. For every 8 > 0, there exists a function o n ^(l) 
that goes to zero as n — >• oo, such that following holds: 



Pr (rank(Go) > min(K,n(l -2s- 5))j > 1 - o„, 5 (l). 

(32) 

The proof of Lemma Q] is obtained by showing that, with 
high probability, each randomly selected column of Go is in a 
general position. We omit the proof. Clearly the receiver can 
uniquely recover (bf © bf) from 



(bf © b^) • Go 



(33) 



if Go has full row-rank, which holds if R < 1 — 2e — 6. Since 
5 > is arbitrary this establishes our first lower bound. 

B. Achievability of R = 1/2: Decode and Forward Approach 

The rate R = 1/2 is achieved by transmitting both w\ 
and w 2 to the destination instead of taking advantage of the 
fact that the destination only requires w\ ® w 2 . The multiple 
access capacity region is given by the convex hull of rate pairs 
(Ri,R 2 ) that satisfy: 



R\ < s\y) 
R 2 <I(y;z,s\x) 
i?i +i?2 < I{x,y;z,s) 



(34) 
(35) 
(36) 



Taking x and y to be independent equiprobable binary sym- 
bols we get that MAC Capacity region contains Ri < 1 — e, 
R 2 < 1 - £ and R 1 + R 2 < 1. Since e < 1/2 the rate pair 
Ri = R 2 = i is achievable. Thus each user can transmit 
at a rate of R = 1/2 to the destination. The destination then 
computes W\ © w 2 . 

Remark 1. The rate R = 1/2 can be achieved using a 
decode and forward scheme even when the two transmitters 
use identical codebooks. As established in HI IV . in addition 
to (134l l- (1361 l, an additional constraint 



R < -f(*,y;^,s|x ffiy) = 2e 

must be satisfied when identical codebooks are used. Thus 
the achievable rate now reduces to R = min(l/2,2e). Note 
that with with identical codebooks, the rate R = 1/2 is 
achievable for e > 1/4, the region in which decode and 
forward dominates compute and forward discussed before. 

C. Achieving R = 1/2 with Compute and Forward 

The rate R = 1/2 can also be achieved using identical linear 
codes if the receiver does not ignore the output when S; ^ 0. 
Let Let Go = G| Si=0 , G\ = G| Si= i and G 2 = G| Si=2 be the 
projections of G onto the indices where Sj = 0, s, = 1 and 
Si = 2 respectively. Following (l3Tl l. we let = (hj +bf )Go, 
z 3i = "l&i and Zg = bf G 2 . Furthermore along the lines of 
Lemma [T] it follows that for any 5 > 0, with a probability 
that exceeds 1 — o„ ,s(l), we have that 

dim ^col-space(Gi) U col-space(G 2 )^ < n ■ min(2e + 5, R) 

(37) 



and since the columns of Gi are independently sampled, it 
follows that, 



dim ^col-space(Gi)J > n ■ min(e — — , R), i = 1, 2. (38) 
Thus using the relation 

dim ^col-space(Gi) ("1 col-space(G2)^= dim ^col-space(Gi 

+dim ^col-spacc(G2)^— dim ^col-spacc(Gi) U col-space(G2) 

(39) 

it follows that with a probability that exceeds 1 — o n .s(l), we 
have that 

dim ( col-space(Gi) ("1 col-space(G2) ) > n ■ d\ 2 



A 



n(2e -R-S) + 
(40) 



Thus one can find a matrices Mi such that 

GiM 1 = G 2 M 2 = A 



(41) 



where A is a full-matrix of dimension n x d\ 2 . The receiver 
first computes 



(z^ © z£)M = (bf ®hl)-A 



(42) 



and then needs to compute bi ffib2 from (bi ©b2) T [Go A]. 
Since the entries in Go and A are independent the rank of 
[Go A] is, with high probability at-least n(di 2 + 1 — 2e — 5). 
From (l40l we can show that R = max(i 1 — 2e) is achievable. 

V. Upper Bound: Proof of Theorem[T] 

We begin with some notation. For a given sequence s" 
A(s n ) = {i : Sl = 1} and B(s n ) = {i : Si = 2}. Let 
C(s") = {i : Si = 0}. Define x\^ sn ^ to be the projection of 
the sequence x n on the indices where Sj = 1 and use a similar 
notation for other indices. 

Since the receiver decodes u = Wi © w 2 from its output, 
from Fano's inequality, we have that 

-H{u | s",z") < S n (43) 
n 

for some sequence 8 n that goes to zero as n — > oo. 
Now consider 

nR = H(u) (44) 

= H(u\s n ) (45) 

= H{u\s n ,y% {sn) ) (46) 

= n6 n + I(u;xZ (sn)) z2 (sn) \s n >y % (sn) ) (47) 
= n6 n +H(x^ sn) ,z2 {sn) \s n , y % {sn) ) 

-H(x^ sn) ,z2 (sn) \s n ,y% (sn) ,u) (48) 

where d45l > follows from the fact that the message u is 
independent of the sequence s™. Eq. ( |46*] i follows from the 
fact that u = Wi © w 2 is independent of w 2 and hence also 
independent of y n . Eq. j47| ) follows from the chain rule of 
mutual information and the application of Fano's inequality. 
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We upper bound the first entropy term in (|48) as follows. Now using (l52l and the fact that T n C S n we have 

H(x% (sn) ,zZ (sn) \s n ,y% (sn) ) <H(x% (sn) ,z2 (sn) \s n ), (49) nR < n(l - s) + nS n 

< ]T Pr(s n = s n )(\A(s n )\ + \C(s n )\) (50) - £ #(*V) I^V)' "'^ = = s ")" 

= n(l - e) + nS n (51) ( 58 > 

where © follows from the fact that conditioning reduces Similarl y "PP 1 ^ 63 to the permuted sequence tt(s") we 



entropy. Eq. ( |50l follows from the fact that both x™ and 



z 



have 



are binary sequences. Eq. (IBTt follows from the fact that s" 7^ < ^(i — + tm^ 

is sampled i.i.d. from a distribution with Pr(s = 0) = 1 — 2e x ^ n n n n n n n 

and Pr(s = 1) = Pr(s = 2) = e. H ( x A(7r(s^))^ z c^(.^)) Wb^s™)), u , s = s ) Pr ( s = s )■ 



Substituting dBTt into d48b we have: 



s"er„ 

(59) 



nR < n(l - e) + n<S„ - iJ(x^ (s „ } , z£ (sn) \s n , y^y u ) Combining (|58) and ([59j we have that 

(52) 

nR < n(l — e) + n<5 n 
We now separately consider the cases when either < e < , 

IandwhenI<e<I _ £ # (x^^, 2? (ir(>n)) |y^ (sB)) , u, s" = s n ) 
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A. Case: \ <e <\ 

Let 7^ C 5" be the set of all sequences such that 

\A(s n )\ > \C(s n )l 



< nPr(s n = s n )< n5 n (63) 

s"£T c 



+ H(xZ (sn) ,z2 (an) \y% isn)> u,s n = s n )\pr(s n = s n ) (60) 
< n(l — e) + nS n ~ 

By the weak law of large numbers we have that Pr(s™ 6 2 s ^"j- ^-^it 6 )'-^ c ( s )^t3(s )> ) ( ) 

7^) > 1 — 6 n and Pr(s n £ 7^) < <5 n for some sequence <5„ (61) 
that approaches zero as n — > oo. 

For each S " € 7;, we define a permutation function as where the last relation follows from 63- Now observe that: 

follows. Let Ai{s n ) denotes the first \C{s n )\ indices of s" ^ H{y^ i(sn) , y™ (sn) \y™ (sn) , s n = s n )Pr(s" = s n ) (62) 
where s, = 1 and ,A 2 (s™) denotes the remaining indices. 
Thus .4(s") = ^.i(s")U^ 2 (s") and every element in Ai(s n ) 
is smaller than every element of A2(s n ). The permutation 
function 7r(s n ) is chosen such that C(7r(s")) = Ai(s n ) and 

Ai(n(s n )) — C(s n ). Furthermore yl 2 (7r(s ra )) = ^(s") where the second step follows from the fact that the sequence 

and B(n(s n )) = B(s n ). Note that |.4(s n )| = |.4(7r(s n ))|, y" is binary valued and the last step follows from the fact that 

\B(s n )\ = \B(ir(s n ))\ and \C(s n )\ = |C(tt(V 1 )) holds. Fur- Pr(s" eT n )>l - S n holds. Now observe that 

thermore since the probability of each sequence only depends ^ tt( n n I 11 ™ — n \ p ! n — ™\ 

on its type, we have Pr(s n = s n ) = Pr(s" = ir(s n )) for each ^(y>li(s™)>yc(s»)|yB( s ™)> s = s ) Pr ( s = s ) ( 64 ) 

Observe that for each s" = s" £ 7"„ we have that, = 2^ H (yX(s«)> yE( s --)\yS(s--): s " = s ") Pr ( s " = s ") 

TJ ( v n _n I ,,n ,. 

( C(s " )|ye(s " ) ' ' } - V H( y X (s n ) ,yZ sn) \y% is n ) ,s n = s n )P T (s n = s n ) 

+- H ( X ^(7r( S "))' Z C(7r(s"))l>'i3(7i-( S "))i U ' S J P- 5 ^ S »6T„ C 

= HixX^xX^z^yZ^s") (65) 

+ ^ WS ")):^ WS "))^cV(,"))ly^ (S "))."^ n ) ^ ^(rl^j-ycV)^)' 5 ")-^"- < 66 > 

^ ) Substituting into (loTl l we arrive at: 

TT(„n „n _ri |,,n C n\ 

+ H7x" y» z™ \v n u s") r55^ ni? < n ( 1 - £ ) + 2n ' 5 n-x J ff(y^ l(sn ),ycV)|ye(s") 1 s") 



(67) 

- -"( X ^i(s")' X ^ 2 ( S "): Z C(s")' X C(s")) Z >t 1 (s")|ye(s") i S j i 

(56) < „(l - e ) + 2nd n - ^H(y^ sn) \y^ sn) ,s n ). (68) 
> H(v n v n \v n s") (57) 

— Ai(« n )> C(s n )l/B(s«)' ^j so smce the decoder is able to compute w\ © w 2 from 
where (|53T > follows from the construction of the permutation (z",s n ), we have: 



function 7r( ). Eq. d56l l follows from the chain rule of the en- 
tropy function and the fact that conditioning reduces entropy. 

Eq. ([57} follows from the fact that z" = x" ©y" and the fact = #(w 2 |wi) ( 70 ) 



nR = H{w 2 ®w l ) (69) 
= H{w 2 \ Wl ) (70) 
that (s",y") is independent of (wi © vv 2 ). = H(w 2 \w u s n ) (71) 
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H \w2\wi,s n ,xZ (sn) ,xg (s 
H ( w 2 1 w u s n , x^ (s „ j , x£ (s „ } , yg (s 



.ycV: 



S ' X ^(s")i x C(s™)> 



+ / ( w 2;yB( S «) ) yc(s«)l w i ! 
<n5 n + ff(y£ (sn) ,y c " (s „)Is") 
= nS n + H(y^ sn) \s n ,y^ sn) ) + H{y% {sn) \s n 



(72) 

(73) 
(74) 
(75) 



where (fTOl i follows from the fact that Wi and w 2 are inde- 
pendent. Eq. ( f7TT i follows from the fact that the state sequence 
is independent of (w\, w 2 ).Eq. ( 1721 follows from the fact that 
from construction, (xj£/ s n) 5 x c(s n )) cons i sts entirely of symbols 
transmitted by user 1 and hence is independent of w 2 . Finally, 
Eq. (l74l follows by applying Fano's inequality since w\ © w 2 
can be decoded from (z",s n ). Combining ( f68b and (|75] l we 
have that 



-ii <(!-£) 



-<5„ + -£ 
2 2 



1 



(76) 
(77) 



oo we recover R < as 



Since 5 n vanishes to zero as n 
required. 

B. Case: < e < § 

We let C 5™ to be the set of all sequences such that 
|C(s ra ) > „4(.s")|. From the weak law of large numbers we 
have that Pr(s n £ T n ) > 1 — 5 n and Pr(s" S n , for 

some sequence S n that goes to zero as n — > oo. 

Split the set C(s ra ) as a union of two sets i.e., C(s n ) = 
Ci(s") UC 2 (s"). Let Ci(s") be the first \A(s n )\ elements 
of C(s n ) i.e., |Ci(s")| = |^(s n )| and each index in d(s n ) 
be smaller than each index in C 2 (s"). We let 7r(s") be 
a permutation function such that Ci(s") = A.(ir(s n )) and 
A(s n ) = Ci(n(s n )). Let C 2 (s") = C 2 (7r(s n )) and B(s n ) = 
B(tt(«")). 

Following the the sequence of steps similar to (|57T i we have 
that for each s" 6 T n , 

^(. X ^( S ")> Z C( S ")|yS( S "):"> S ) 

+^( X 5(7r(s™)): Z C(7r(s«))|yB(7r(s™)): U J S ") ( 7 8) 

TTl^n n _n |,,n _n\ 

- - H ( X ^(s")' Z Ci(s")) Z C 2 (s")iyB(s")' U ' S J 

+F(x c " i(s „ ) ,zV).^ 2(a n)|yV)' u ' sri ) ( ?9 > 

- - H l X ^( S ")' Z Ci(s")' Z C 2 (s")' X Ci(s")' Z ^(s")iyB(s")' ' S J 

(80) 

- n ( x ^(s")' x c 1 (s")' z c 2 (s™)'y^(s™):yc 1 (s' i )iyf3(s")' o ' s > 

(81) 

>%c l(s .)jV)l4")' u > sn ) < 82 > 
= # (y c V)'yV)iy^")' s ") < 83 > 

where d79b follows from the construction of the permutation 
function tt(-) and the fact that C(s") = Ci(s") U C 2 (s"). 
Eq. <f8Qb follows from the chain rule of entropy and the fact 
that conditioning reduces entropy. Eq. (ISTj follows from the 
fact that z" = x" © y". Eq. follows from the fact that 



u = Wi © w 2 is independent of w 2 and hence y". Following 
the sequence of steps similar to (|68l we have that: 



1 



nR < n(l - e) + 2n<J„ - T^(yV)'^V) S " 



(84) 



< 



n(l - e) + 2nS n - -H(/ C \ {sn) \y£ {5n) ,s n ). (85) 
Following the sequence of steps leading to d75l l we have 

nR < n5 n + H(yl {sn) \s\yS {sn) ) + H(yS {s n V yl is n ) \s n ). 

(86) 



Combining ( l86l l and ( I85l l we have 

^ni?< ^ ri + n(l- £ ) + ^(y^ (s „ )l y c " 2(s „ ) |s") (87) 
< |n<5„ + n(l - e) + ^[|S(s n )| + |C 2 (s n )|] (88) 



< |n<5„ + n(l - e) + £(l-2e). 



(89) 



Since <5„ vanishes to zero, as n — > oo, i? < holds, which 
completes the proof. 

Thus we have established Theorem Q] for < e < 1/3 and 
1/3 < e < 1/2. For e = 1/3 the upper bound follows by 
observing that the capacity is monotonically decreasing in e 
and the upper and lower limits to the upper bound function at 
e = 1/3 both equal 5/9. 

VI. Coding Technique with Feedback 

We provide a sketch of the achievable rate with feedback 
stated in Prop. [2] We use a two phase protocol. In the first 
phase encoders 1 and 2 transmit bu and b 2 i respectively for 

1 = 1,2 ... ,n. For those indices where $ = the receiver 
obtains bu © b 2 i. Among the remaining indices users 1 and 

2 construct w\ = j '>;,},:.., j and w 2 = {!>>,} rJ , \. In 
the second phase, the messages wij and w 2 j are transmitted 
to the destination using a multiple access channel code. By 
computing the capacity region of the associated multiple 
access channel (c.f. d34T>-d36T>">, it can be verified that the 
number of channel uses in this phase is « 2ne. Thus the 
total rate is w — ^ — = . A, as required. 

The upper bound is obtained by revealing one of the 
messages, say W\, to the destination. Thus only w 2 needs to 
be communicated to the receiver. For such a point-to-point 
problem, it is well known that feedback does not increase the 
capacity of C = 1 — e. Thus R + = 1 — e is an upper bound 
even when feedback is available to the transmitters. 

VII. Lossy Reconstruction 

We establish the bounds stated in Theorem |2] For the 
achievability scheme, both the users only encode first k\ < k 
source symbols. The encoding functions at the two users are 
selected in order to communicate the modulo-sum u kl = b^ 1 © 
b\ x in a lossless manner. Thus user 1 generates x n = fi{b\) 
and user 2 generates y™ = f 2 (b 2 ) where the encoding 
functions are selected according to either the compute-and- 
forward or decode-and-forward schemes discussed previously. 



8 



It follows that the decoder can recover u kl with high proba- 
bility if ki < nR~ where R~~ = max{i, 1 — 2e} is our best 
achievable rate. The decoder declares an erasure for all indices 
j G [ki + 1, k]. The associated distortion per symbol satisfies 



(fc-fci) + 
k 

(i-pR-y 



(90) 
(91) 



as required. For establishing an outer bound on the achievable 
distortion we note that applying rate-distortion theorem to the 
erasure distortion metric and i.i.d. equiprobable binary sources, 
we have ifTTl that R(D) = 1 — D. Furthermore from the 
definition of the rate-distortion function note that if D is an 
achievable distortion metric then: 



kR(D) < I(u k ; u k ) 

< I(u k ;z n ,s n ) 
= I(u k ;z n \s n ) 

— Tl ll k - V™ 7 n 

< nR+ 



7 n I C™ 1 

> z C(s")l s ) 



(92) 
(93) 
(94) 
(95) 
(96) 
(97) 



where d93t follows from the data processing theorem and 
follows from the fact that the source sequences are independent 
of the state of the channel, d95l l follows from the structure of 
the channel where the sets A(s n ), B(s n ) and C(s n ) are defined 
in the beginning of Section [V] and (l96l l follows from the fact 
that ygV s „) is a subsequence of the codeword y" transmitted 
by user 2 which is independent of s k and hence u k = s k ffisf, 
since the sequences are i.i.d. and equiprobable. Applying the 
same steps as in our upper bound (c.f. (|47| |) we have that 



R + = 



(l-3e)" 



2-e 



3 



Thus we have that 



Pouter > (1 - PR + Y 

where R + is defined via 



(98) 



(99) 



VIII. Extended Multiple Access Channel: Proof 
of Prop. [3] 

In this section we establish the upper and lower bounds 
stated in Prop. [3] Recall that for the extended model the 
channel output z can take one of five possible values: Pr(z = 
x) = Pr(z = y) = 5 ■ e, Pr(z = x © y) = 6(1 - 2s), 
Pr(z = (x.y)) = 7 and Pr(z = *) = 1 — 6 — 7. 



A. Proof of Lower Bound (124b 

We first show that R~ = i<5 + 7 is achievable by com- 
municating two independent messages to the receiver each at 
rate R~ . Recall that any achievable rate pair (i?i,i?2) of the 
multiple-access channel can be computed via 



Ri < I(x;z\y,s), 
R2 < I(r,z\x,s) 
Ri+R 2 < I(x,y;z\s) 



(100) 
(101) 
(102) 



Evaluating for the equi-probable input distribution we have 
that 



Ri < *(l-e)+7 
R 2 < 6(1 -e) +7 
R 1 +R 2 <6 + 2 7 



= ¥ 



(103) 
(104) 
(105) 

+ 7 is 



16 + 7 is 



Since e < 1/2 it follows that Ri = R 2 
an achievable rate-pair. This establishes that R 
achievable. 

When identical linear codebooks are used for decode and 
forward, following IfTTl we require an additional constraint on 
the rate: 

R < I(x, y; z, s\x © y) = 7 + 26e 

and hence the achievable rate reduces to R = j+6 min(2e, i). 
As the decode-and-forward scheme only dominates for e > 
1/4, there is no penalty from the additional rate constraint 
involved from using identical codebooks. 

To establish that R~ = 7 + 6(1 — 2e) is also achievable, 
we use identical linear codebooks at the two transmitters. In 
particular transmitter 1 computes x T = hj G and transmitter 
2 computes y T = b^G where the entries of G G F!^*™ 
are sampled i.i.d. from an equiprobable Bernoulli distribution. 
The receiver only keeps the output symbols corresponding to 
s = and s = 4. When s = 4 it computes z = x © y from 
the received pair (x, y). Thus the total fraction of non-erasures 
at the receiver is 7 + 6(1 — 2e). It can then be shown, as in 
Prop. Q] that R = 7 + 6(1 — 2s) is achievable. 

B. Proof of Upper Bound ( 125b 

Our upper bound analysis closely follows the proof of 
Theorem Q] We only illustrate the main points of difference 
due to the addition of the two extra state values. Following 
the steps leading to d48l >. we can show that 

nR < no n (l) + H(x^ sn) ,z^ sn) ,x^ sn) \s n ,yS {sn) ,y^ sn) ) 

~ U \ x A(s")i z C(s")i x V{s")\ s >y8(s™)i u >yD(s»)J- 

(106) 

where the sets A, B and C are as defined in Section [V] and let 

V(s n ) = {i : Si = 3} and £(s n ) = {i : s t = 4}. 
Through standard arguments we have 



n(v n 7 n v n \<: r ' 

n l x ^(s")' Z C(s")' X I5(s")l s 

<E[\A(s n )\ + \C(s n )\ + 



,y£(s^y^)) d07) 

|2?(s n )|] =n*(l-e) + n7. 

(108) 



From ( 1106b . dropping the o n (l) terms to keep the expressions 
compact, we have 

nR < n<5(l — s) + 717— 

i/(xV),^(s"), x V)l s "^H(s")>^yV))- ( 109 > 

We assume that < e < 1/3 and let T n denote all 
sequences s" such that \C(s n )\ > |yl(s™)|. As before let 
C(s n ) = Ci(s") U C 2 (s n ) where C x (s n ) denotes the first 
yl(s")| elements of C(s n ). From the weak law of large 
numbers Pr(s" G T n ) > 1 — o n (l) holds. 
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Let 7r(s") denote a permutation of s" such that Ci (7r(s™)) = 
.A(s n ) and A(Tr(s n )) = Ci(s"). Furthermore let B{ir(s n )) = 
B{s n ) and C 2 (7r(s n )) = C 2 (s") be satisfied. Also the sets V 
and £ are invariant under this permutation mapping. Apply- 
ing d 1 09l > to the sequence 7r(s") we have that 

nR < — e) + 777— 

n \ X A(Tr(s™))' Z C(n(s"))> X T>(tt(s™))\ S i/B(s")! "i 777(5") )• 

(110) 

By following the steps leading to d83l ) we can show that 

Tjf^n n n i n ,,n n \ , 

-"l X ^l(s")' Z C(s")' X I7(s")l S ' y/3(s") > >P(s") > "/ + 

-^( X X(ir(s"))' Z C(7r(s"))' X 5(7r(s"))l Srl '>'8(s")' U >y-D(s")) (HI) 

> %V)'^( S »)l 5n '4»)' I '>^( S »))- (112) 

It follows from (fT09l , (fTTOt and (fTT2l > that 



ni* < 77,5(1 -e) + 777 - ^^15",/^,/^^)). 

(113) 

Furthermore if x" is revealed to the decoder, it follows that 
the decoder must decode 1/1/2. Thus 

nR<H{y% (sn) ,y2 (sn) ,yZ {sn) \s n ) (114) 

=^(yBV),y5(s"),yc 2 (s")k") + ff(yc l( s")|s ri ,yeV)^S(s")) 

(115) 

< 77(7 + fe) + 77(1 - Ze)5 + H{yl {sn) \s n ,yZ {sn) ,yZ {sn) ). 

(116) 



Combining ( II 13b and ( II 16b to eliminate the entropy term we 
have that 

^nii < ^n 7 + n£(l-ie) + ^ (1 - 3 £ )<5, (117) 
which results in 



R < 7 + 6 



2 - e + (1 - 3e) 



(118) 



for e < 1/3. For e > 1/3, one can similarly establish that 

'2-e 



i? < 7 + 5 



(119) 



understood when we consider other relevant channel models. 
We hope that techniques developed in this paper are useful in 
other related problems in this emerging area. 
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which completes the upper bound analysis. 



IX. Conclusions 

We study computation of the modulo-sum of two messages 
over a multiple access channel with erasures. Unlike the 
Gaussian channel model, this model does not have a suitable 
structure to directly compute the modulo sum. Our main result 
is an upper bounding technique that converts the setup to 
a compound multiple-access channel and results in a tighter 
upper bound than the usual cut-set bound. Using this bound 
we establish that a simple ARQ type feedback can increase 
the modulo-sum capacity for our channel. We also consider the 
case when a lossy reproduction of the modulo-sum is required 
and observe that uncoded transmission is sub-optimal even 
when there is no bandwidth mismatch. 

While function-computation over Gaussian networks has 
recently received a significant attention, the problem is far less 



